Papers with fine-tuning accuracy
Preventing Safety Drift in Large Language Models via Coupled Weight and Activation Constraints (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing defenses constrain either weights or activations in isolation, without considering their coupled effects on safety. |
| Approach: | They propose a weight-activation constraint that enforces a precomputed safety subspace on weight updates and applies regularization to safety-critical features identified by sparse autoencoders. |
| Outcome: | The proposed model outperforms baselines even under high harmful data ratios. |
MobiZO: Enabling Efficient LLM Fine-Tuning at the Edge via Inference Engines (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are currently pre-trained and fine-tuned on large cloud servers . fine-timing on resource-constrained edge devices presents significant memory and computational demands . |
| Approach: | They propose a resource-efficient fine-tuning framework for LLMs specifically designed for edge devices. |
| Outcome: | Experiments show that MobiZO achieves substantial runtime speedups and memory savings while improving fine-tuning accuracy. |